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RELATIONSHIPS AMOKG FACTORS IN NEW 0F^>TCER 
EFFECTIVE'NESS REPORT SYSTEM 



INTRODUCTION 



Vin 197.4,-aJiew Air Force Officer Effecti^^ess 
Rep6rt (OER)' system -became ; ope rati bria^/ X' 

' significant change introduced in the system is* the * 
controlled distribution of Evaluation of Poterrtid, 
' ratings' in Block V of AF Form. 707. ^The con- 
trolled distribution aspect of the system imposes'^ 
lirnit of 22% pf the Bloclc V ratings given by- a 
reviewer in the 'top blocks a limit ot^28% in the 
second block, and the option, to distribute the 
retnaining 50% across the bottom /our blocls. 

* These controls apply, only to reviewers. The first . 
rating official in the "chain, the ratei», and the 
second, the adclitional rater, are not ^required to 
^conform to the specified distribution in assigning 
Block V ratings. Another significartt.(leparture 
from the t)ld system is a" constraint placed' upon 

' the rater in assigning ratings to the ICT Performance 
Factors in Block III of Form 707. A rating on a 
Performance Factor may range from Far Below 
. .Standard to Well Above *^t an dard. This range, is 
graduated in five steps with Meets Standard atithe 
midpoint. The rater also has the optio;i of using a 
Not Observe^^h.^or Not Relevant rating^ if 
appropriate, on a specific factor. If the rate|j,(|ofes 
not use either the Meets Standard or Not Observed 
block, he must document the rating with a specific 



exaiT^le of performance.' Th^ 28% limitation on- 
seCond block ratings of Evaluation of ^Pote.ntial 
was removed in 1977. 

A statistical' analysis has been carried out to 
focus on "the individual PerfonnaiTce Factors, 
Evaluation of Potential ratings, jind the interreja- 
tionshi^s^ainong these yaria^les. D^ta aised in'the 
. study<.are t}ie rating contained in 9,230 controlled 
reports prepared on lieutenant- colonel ratees 
during the'witido>^ penod 30 Novernbej: 1974 — 
' ' 31 . March 1975, Jhese reports constitute* the firs't 
. controlled report cycle ifi the new OER system. 

• . ■■■ ■ ■/ 

II; PERFORMANCE FACTORS 

For^ the purpose of^ -this study,* Performance 
Factor ratings were ^gigned numerical values from 
5 for Wfll Above Standard to 1 for Far Below 
Standard, Npt-Obs^^rY&d/Ndt Relevant ratings were 
not converted to this numeric scale. Of the 9,230 
re^fxorts, 9,149 had cp m pie te (numeric) data avail - 
able\jft ^ 10 Performance Factors. The means 
X^nd standard deviations of rating^ assigned by the 
rater, by the additional rater, and by the reviewer 
are displayed in Table 1*. - 



" Table L Performance Factor Means and Standard Deviations 


Performance Factor 


V . - . 

Rater 




. Additional 
l^ater 


. Reviewer 


Mean 


SD 


Mean 


SD 


Mean 


SD 


Job Knowledge 


4.67 


.60 


4.67 


\60. 


4.67 . 


.60 


Judgment and Decisions - 


" 4.47 


.71 


t 4.46 ' ! 


-.72 • 


'4.46 


.72 


Plan and Organize Work ( 


••4.5^^ 


.69 


4.52 i 


.69 


4.51 


- .69 


Management of Resources 


^4.52^' ^ 


.70 


4.51 


:.76 


4,51 


.70 


Leadership . 


/ 4.51 


.71 ' 


4.50 


;.72 


4.49 


' -.72 


Adaptability to Stress 


4.49 


.73 


4:48 


i.73 


4.48 


.73 


OralCommunication , 


4.42^ 


'.75 


4.41, 


.75 


4.41 


.75 


^Written Communication 


4.46\ 


.73. 


4.45.^ 


.73 


4.45. 


.73 


Professional Qualities 


4.61 ^ 




4.61- 


.67 


4.61 


.67 


F.qual Opportunit\|{'Partici|^ation 


4.42, 


.80 


4.41 . 


.80 


4.41 . 


.80 




5 




.1 


. J. 






For the entire^ group 4f 9,230 reports, the 
pwcent t)f "ratings assigned each Value by raters is 
shown in Table 2. Percentages are roun*ded to the 
nearest fenth. ^ ^ 

It is evident tliat the predominant Factor rating 
fs 5, \\^11 Above Standard, for each, of tfee ten 
Performance Factors: Tlip Job Knowledge ^^WJf^ 
-ra^d, 'Well Above Standard more fretjuently, 
j^; than afty oth^ef factor. CohveViely, it is 
r^^tid Meets Standard ^ss* fiequently, 6.49^ than* 
afiy other faqtpr" Ojal Gpmmunic^tlon is. rated 
Well" Abover^ta»dar*d|^l>y raters fess. frequently, 
57.8%, than any bthei factor. Equal Opportuni^ , 
Participation is ratij^'^ Meets Stafidajd more 
frequqntl^, 20.0%, than 'an>^. .other factor. ..-The' 
rtiAiiber of B^ow Stahdard/rdrtings is in§ig:nificai]^.'- 
It varies fr(?m pne^ for Equal Opportunity 
Participation to 20 for the Leadership factor.. 

'is a single ratiffg of Fa^ Below Standard 
jiv^hg thte 9,230 reports. It is for Professional 
""Qu^itiest- The; number of^Nof Observed ratings 
y'inges.from^ero.fof Equai Opportunity Pajticipa- ^ 
j4on to 59 4rfM|^he Management pf^-ftesourtek 



The 'de^ee to which separate rating officials in 
the raJting chain agree in^he use of Performance 
Factor ratings is suggested by rtearly identical 
, means for . the three- classes of rating officials' on 
each Perfomjance Factor. This agreemwit is also 
indicated by fact, that, of the 9,149 reports for - 
:^ which complete dait^are available, 93.1% cqntaki. a ^ 
' -..^e.t of fejfonriance Fact(ji4ratings^s^ 

rat^r whicjt^ii identical td'ratings\ssignedtby the.^ 
*r^'dditional .raterJ'^so, ^.9^^.^ oi^^the* reports 
contail^ identical rat^gs assigned by the rater, and 
the - reviewer. Wie additional rater/reviewer 
/agreement is 9§.5%. - ^ / ^ 

.Correlatiofi coefficient reflecting the ^lela^ 
, "rtionships, -between ' Performance Factocs were 
^ computed for tlie ?,149 /reports- containing 
complete data.; Major .results of this corfelational 
' analysis are summarized^ Lfi Table/ 3. Data are 
organized separately for ratings ^ssigne 3 by 'raters', 
4iy additional raters, and by reviewer^! The table 
, displays the highest and the lowest correlation of > 
each factor with the" remaining factors within the 
ratings gssigned by each type of rating oglfeirrhe 
median is also rC^orte'd. . ^ ■ ^ 



Table 2. Distribution of Performance Factor Ratirigs^R 

^ t. - ^ (Raters) : ' * \ ^ 



Ratings 



Performance Factor 



J of! Knowledge 

J udgmcr|A and Decisions 

plan and OrgiTni^e Work' 

Management of R^e sources 

Leadership 

AcfaptabiHty to Stres^ ^ 
Oral Gonimunication 
Written Communication 
Professional Quati'ties 
Equal Opportunity P^rticipatip^n 

Totdl . ^ 



Not 
Observed 



■± 



59.9% 
63.7% 
63.3% 
63.3% 
>62.8% 
' 57.8% . 
60.1% 

61.4% 
i3,8% 



19.4% 
27.6% 
2'5.4%^ 
24.5%' 
24.0% 
23.3% 
26.4% 
25.7% 
\S3% 
' 18.6%^ 

23.3%r 



6.4fo' 
12.4% 
10.7% 
1U% 
12.3% 
13.6% 
1.5.7% 
14.0% » 
10.0% 

20 mo ^ 

\2J%- 



0.1% 
0.2% 
0.2% 

o.if 

0.2% 
0:2% 

'a.1% 
0.1% 
0.2% 

0.1% 



0.0% 
0.0% 
0.0% 
0.0% 
0.0% 
0.0% 
0.0% 
0.0% 
00% 

0:0% 
0.0%" 



0.0% 
6.0% 

q.0% 
d.7% 
ai% 
0.2% 
0.0% 
0.1% 
0.0% 

0:09^ 

o;i% 



'3 
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* PerfVf^mancovl^actor 




i J^ib Knowledge 7 
; J'udginent-anChbeclsions 
' . Pfen and ^Organiz^ Work- * ^ 
f^Janage men t of . Resources 
^Leadership • ^ . 

Adaptability to Stress 
. Qr al^y o m m u n ic at i o n 
. Written Communication 

Vjofessional Qtialities ^ 
* Equal OpportuniTy Pant^dp^ia 



(le j^prrelations" 



corrotations are positive, 
ahiong ratings of Performance .Fac^t'i)rs 'as3igne"d by 
r.aters rafige frG(nv^44 to .72,^ The''|niedian!^range 
, from .54fio .6|K. Inspection of TaDYe^J indicates 
that " fate.rs' Performance FactoV^-rattngs are 
nTodcrat'cly correlated within all t^ Pe/formance 
Factors and with minor di^e re tijpUpi be^een 
factors. Tfie data also- indicate a nearly identical 
Tst^ygQ — qJL correlations/ within the ^ratings of 
Performance 'Factors assignecf by additional raters 
- as well as tho^e assigned by reviewers. 

Thc*agrcement between, the use of-F^erformance 
among' 



Factor 



ratmgs 



e three- levels' of rating. 



officials is ^hown in Table 4. The correlation, 
coefficients' between ea\ph pair of rating officials 
fpr the ratings on a given factor are shown. 

In general, the coirelations are extremely high 
and indicate that only'in rare cases additional . 
raters override Performance Factor ratings assigned 
by rat^Ys. . The' correlations between the ratings 
a^signedNbv additional raters and reviev^rs are ' 
sli^tly, but systematically, higher than those for . 
raters and additional raters. This indicates the evc^ ^ 
less frequent override of a factor rating by\the 
'reviewer. 




Tabic _4. Correlation Betw,een Rater Categories 



J- 



Performance Factor 


Rater/ 
Additional 
Rat^r 


xl_i^ater/ 
. , Raviewer ^ 

— — 2 '. 


Additional 

Rater/ 
Reviewer 


Job Knowledge / , 


- .97 




.96 


.99 


\ 


Audgment andiDecislons . - ; 


A,- .97 




.96 


.'99 


• 1 


Plan and Or^;niz^ Work ' . 


' ' .97 




.96 


'.,99 


Management of Resources . * ^ 


■ , ,97' 




. ' .96 


.99 




Leadership \\ 


^ - .96 




. ' 76 


.99 




Adaptiibility fo St-ress^ - . 






J97 


.99 




Oral Communication 


? .97 




' . /:97 


i.ob 




Written ^'©mmunicationi * . 


* .97 


V'- 


^ ' . ■ 1.91 ■ 


.. J. 00 




Profe'sslpnal Oualitie*^ ^ \ ^ 
Equamppdrtunity Participationl 7 


■ .97 




: 1.91 ' 
\91 


1 .00 

.99- 
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111. PERFORMANCE J?ACTGIi|S AND 
. EVALUATION OF POTENTIAL 



' In this section the relationships between 
Performance Factor rating contained in BJocklll 
of the pfficer Effect ivehess Report and ratings of 
Eviluatian of Potential ih Block; V of the report 
will be exa'mined. As bagkgroujid for this discus- 
sion» summary statistics To^. Block V ratings are 
presented in Table S. Tliere are six blocks available 
to rate Evaluation of'.Potential. The controlled 
distribution feature of the system imposes delimit 
of 22% of each reviewer's ratings in the top block 
and a limit of 50% in the top two blocks. For the. 
purpose of this report,- rurmerical values 1 through 
6 have been assigned to top block, secorxd 
block, . . .sixth block, ratings. 

( Tabic 5. Distribution of-Ratings 

\ * of Evaluation of Potential 



Ratings of 
Evaluation 
of Potential 


,6 ■ ■■ 't- 
Rater ■ 


Additianal ^ 
. Rat^^ 


Reviewer 


1 ' 


41.5% 


27.9% • 


21.8% 


2 


33.7% 


32.7%. 


< 29.0% 




23.5% 


37.8% «^ 


. 47.3% 


4 


■ 1.2% 


1.5% 


' 1 .8% 


\. 5 ' > 


0.1% ' 


• 0.1% 


; 0.1% 


6 




0.0% 


' 0.0% 



The controlled distribution target p^cenfages 
•have been" closely adherqi^^to acrosis the population 
of reviewers. 



The exterit ^ oi the, relationship between 
md^du^l Performance Factor ratings assigned by 
raters and .the Evaluation of Potential rating-is 
presented in Table 6, JThe first coltimn displays the 
validity ©f Block ill ratingsi. assigned by the YSter 
for the rater's Evaluation of Potential ratings; the 
second column displays the validity coefficients of 

- the rater's Block III ratings for the additional 
raterV Evaluation of Potential; and the finals 
column contains the validity cdefficients of'rster's 
Block in ratings for the reviewer^s Evaluation of 

* Potential.' 

^ All validity coefficients are negative, since 
numerically high ratings- on Performance Factors 
'^tend to be Associated with numerically low ratings 
on Evaluation of Potential, In displaying validity 
coefficients in Table 6 and in the discussion which 
follows, references to these negative correlation 
coefficients ^ill be omitted,' since the negative 
signs ar^ an artifact of the seeing procedure. 
Validity coefficients for raters' Evaluation of 
-Potential ratings', range frpm^ -.37 for Equal 
Opportunity Participation* , to ^60 for Leadership/ 
Except for Equal Opport^nfty- Pailidpation, the 
validity coefficients are tightly 'packed in the range 
.47 to .60. The same pattern of "Validity 
coefficients is evident'for- both additional raters'' 
and reviewers* Evaluations of Botential. However, 
the rnagnitude of the validities systematically 
decreases from the raters' to th| additional raters* 
t£> the^ reviewers' Evaluations, ^f Potential, The 
Lepdershi 
of Potentiiaf 



Opportunity -Part* 




ipation 



Id for Evaluations 
fating official. Equal 
mt least' valid in 



Tabic 6. Validity of Raster Performance^ 
V Factors for Block V Ratings 

s, (Sign Reversed) o 



Performance Factor 



--1 ^ ■ — — 

Job Knowledge 
Judgment and Decisions 

' Plan and Organize Work 
Management of Resource's 
Leadership, 

- Adaptability to Stress 
Oral Communication , .\ : 
W^ritten Communication ■ 
Professional Qualities ^ 
Eqn^ Opportunitv^ Participation 



Rater 


Additional 
Rater 


Reviewer 


.47 


38 


.34 


:59 ^ 


.48 


.43 


.54 


' .45 ' ■ 


.40 


.sT 


.41 


.37 ' 


;60 


.50 


.45 


.57 


,46 




.53 


.4,4 


.40 , 


.50 


, ,40 ' ; 


.36 


^52 ^ 


^ .43 




'.37 


130 / 


.27 



. each class. Similarly, Judgment and Declsyans falls 
V next -to Leadership £pr all three rating officials^ 
and Job Kn'owlKig^ mis next to Equal Opportu- 
nity Par t^(Ripat ion for all three, gating official^. ' j 

To exam^e the extent to which combinations 
(5f Performance Factors account for ratings of 
Evaluation of Potential, ^evecal series* of multiple 
«/ regression analyses were- performed. Using the 
raters' Evaluation of Pptential as the dependent 
\ variable, the squared multiple correlation coeffi- 
cient, oT the 10. Performance Factors is .4540. 
This ^ means that an optimailj^ weighted linear 
combination of Performance Factor ratings 
^ assigned by 'raters can account for |j5% of the 
variability with'in raters- Eyaluation Sf , Potential. 
The cofrrcsponding.R^ values are. .3036 and .2438 
for additional raters' and reviewers- Evaluations of 
Potential, respectively, using rateft' Performance; 
FacS^r ratings as independent variables. In the firSl 
s^ries^ of 10 multiple recession problems, eachJof 
fhe 10 Performance Factors was removed. The 
' coniparlsoiljof the resulting R^- with the full model 
R^ using all 10 Performance Factors as indepen- 
dent variables indicates the extent of the indej^n- 
^ dent contcibution of each Performance FackJr to 
the rRmai.ning nirte Per foritiance Factors. A similar 
series of 10 regression systems Was computed usiwg 
additiona^ raters' Evaluation of Pptential as the 
dependent variable and deleting one of the 10 
raters' Performance Factors in each of the 



1 



The Variabje Only columns in. Table ,7 'display • 
Jihe squared validitV coeffiCients^pf'the indivjii^al 
Performance Facto^/ To illustrate how datS 'in 
Tabl^ 7 may be interpreted, the 10. Perfo^^air^ee~^ 
Facto^ as a group have<^an' R' of .4640 for rat^rs^ 
Evaluation of Poten^al. When cortsidered; alone, 
the Leadership factor has a squared validity coeffi- 
cient, of .3618. '\yhen*Leadership is removed from 
the set. of 10 Performance Factors, the temaifiing ^ 
nine Performance Factors yield an R^j of .4408. 
Indivi dual. Performance Factors^ afcotint for 
between 14% and 36% of, the van'ability in "raters' 
Evaluation of Potential. However, ijbne'of the 10 
independent contributions is of ^, practical 
portance. These individual in^pendent con- 
tributions range from .0007-'. fo/ Written, Com- 
munication (.4540 .4533)'*to' .0132 for^ 
Leadership (.4520 to .4408). A similar pJattem 
emerges - when comparable data for additional-^ 
rater' and "reviewers' Evaluations of Potential are 
examined. Althou^ individual. Performance 
Factors differ s6mewhat in\ their predictability of 
additional raters' and revfewers' Evaluations of 
Pptential, no single Performance Fa5t3V n;akes a 
siJ^stantial independent contribution to the pre- 
dictability of these 'two dependent variables. 

A, distinct decrease Th^he, predictability oTthe 
dependent variable is observed between the raters', 
additional raters', and reviewers' Evaluations of 
Potential. In order to farther ascertain and 



problems.' Finally, a third series was carried put ^||^ evaluate '^he ric^ of raters' Performance Factor 
using tlie* reviewers' Evaliiatioh of Potential as the ratings ih the assignment' of -re vie we rl ratings of 
dependent variable. A summaf^of these results is potential under the limitations of^the constraints 
displayed in Table 7. . * imposed by the controlled disfribution system, 



Table 7. Predictability of Evaluation of Potential 



V 



Performance Factor 



Rater 



Var. 
Oriiy* 



Var. 
Deleted' 



Job Knowledge 
Judgement and Decisions 
Plan and Organize Work 
' Management of Resources 
LeadersMp. 
Adaptability to Stress 
Oral Conim'unication 
Written Communication 
Professional Qualities > 
Hqual Opportunity Participation 

^^^^ ~ ^ 



.2229 
.3506 
.2940 
^625 
.3618 

a3204 
.2831 

. .2459 
.2758 

• .1379 



.4529 
.4451 
.4506 
.4523 
.4408 
.4492 
.4497 
.4533 
.4524 
.4487 



Additional Rater 



Var. ; 
Only 



,1425 
.'i343 
.1995 
.1694 
.2450 
.2105 
.1921 
.1586 
.1822 
.0907 



- Vac- 
Deleted 



.3033 
.2971 
.3001 
-^30 
.2930 
.3009 
.2996 
.3034 
.3027 
.3D00 



Revlewe 



Var. 
Only 



Var. 
Deleted 



.1145 

.1879 

.16.16 

.13g5 . 

,2009 

;1670 

.1583. 

.1314 

.151^3; 

.0750: 



.2464*^ 
).2420 ; 
.2439 
.2460 
.2373 
.2452 
.2430/ 
^463 
' ;2'455 
.2438 
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addittonal • multiple regressHzm systems were 
computed. For a model in which the feviewer's 
Evaluation of Potential was the dependent variable 
and the independent variables consisted of both ^ 
the rater's and additional rater's Evaluations of 

* Potential, as well as the 10 Performance Factor 
ratings' a'ssigned by the rater, the is .7602. 
Wlien only the ratings of Evaluation pf Potential 
assigricd by ihq, rater and by the additional rater 
are" used to predict, the reviewer's Evaluation of 
Potential, = .7599. It is evident that raters' 
Performance Factor ratings have Virtually ^ no. 

. systematic relationship to reviewers' Evaluations 
of Potential after the Evaluations of Potential 
assigned by the rater and the additional rater have 
been taken into account! The validity of the 
additional raters' Evaluation of Potential for the 
reviewers' Evaluation of Potential i^.87, and the 

^squared validity is .7592. Tlie validity of the 
raters' Evaluation of Potential is .69, and the 
squared validity is .4713. While both Evaluation of 
Potential variables (rater and additional rater) have 
substantial validities for the<revle,wers'''^aluations 
of Potential, and both variables individually 
account for a larger proportion of the variability .in 
reviewers' Evaluation of Potential than a linear 
combination of all 10 , Performance Factors, it is 
clear that the additional raters' Evaluation of 
Potential accounts for substantially all of the 
predictable variance in the reviewers' Evaluation of 
Potential. Tliis fact is further substantiated by the 
agreement between additional raters and reviewers 
in assigning Evaluation of Potential ratings. On 
84.4% of the reports the additional rater and 
reviewer assigned identical ratings; in 15.1% the 
revfewer lowered the -additional rater's rating 
(higher numerical value on a^c^le of 1-6); and in 
0.69c'* the reviewer raised the rating. Corresponding 
figures for the agreement between reviewers and 
raters are 6037c, 38.49f, and 1 .3%, respectively. 

Wlien the rater's Evaluationrof Potential and his 
ratings of Performance Factors are used in a 
multiple regression system to account for the- 
additional rater's Evaluations of Potential, R^ = 
.5929. As noted previously, the squared multiple 
correlation coefficient of 10 Performance Factors 
for the fcditional rater's Evaluation of Potential is 
.3036. Tne validity of the rater's Evaluation of 
Potential for the additional rater's Evaluation of 
Potential is .77, and the squared validity is .5903. 
Althougli both' Performance Factor ratings and • 



jat'e/s Evaluation of t^otential ' account for a 
substantial proportion of<» the variability in the 
additional rater's Evaluation of PotS^tial, the 'I 
independent contribution attri,butabie to , t,he 
rater's Evaluation of Potential is considerably 
•larger than that of the Performance Factors.' 

♦ 

IV, DISCUSSION ^ 

. . . • ' ■ V--; v 

The majority of the. Performance Factor ratings 
on the new-Fonn 707 are higli. Mean values for 
individual factors all exceed 4.4 on a five-poi'ht 
scale. There is virtually no use^^ of the lower half of 
the scale. Only 0.2%, or fewer, of the reports 
contained ratings of 2 (Below Standard) on any 
Perform^ince Factor. Thpf- Far Below Standard 
block was used on onl/^one report for a single 
facto'TT^pparently, raters see, no particular 
problem in providing specific examples of Above 
Standard and Well Above St^ridard performance, 
since these blocks are used in 23% and 63% of the 
ratings, respectively. An analysis of the content of 
specific examples cited by raters is beyond the • 
scope of the present study. There would ^em io 
be some question as to whether specific examples 
of Above Standard and Well Above Standard 
performance cited by raters are of uniform 
quality. 

, In general, second- and third-level raters in the 
rating chain accept ratings of performance 
provided by .the rater. Tliere was complete agree- 
ment in Performance Factor ratings between raters 
and additional raters in more than 93% of all 
reports. Over 92% of the' reports refiected 
complete agreement between the raters and 
revie\Yef^. Over 98% of all reports reflect complete 
, agreement between additional raters and reviewers. 
The stability of Perforrnance Factor mean values 
across categories of rating officials and the 
extremely higli correlation coefficients between 
each pair of types of rating officials for each 
Pprfo nuance Factor^ are further evidence of the 
extent of agreement. As might be expected, tliere 
is slightly greater agreement betweeeji a(^ditional , 
raters and reviewers than between raters and. 
a^dditional raters. Agreement between raters and 
reviewers, althougfrki^i, is slightly below the level 
of agreement betvleen raters and additional raters. 

Intercorrelations among Performance . Factor 
ratings are all positive and of moderate degree. 



EquaJ Opportunity Participation is, in general, less 
highly correlated with the remaining factor? than 
is any other single factor. 

' Performance Factors taken in combination 
correlate more highly with Evaluation of Potential 

' ratings than do individual Performance Factors. 
Although nraters' Performance Factor ratings in 
combination account for approximately 45% of 
the variability in raters' Evaluation of Potential, 
the percent of variance accounted for is reduced to 
ZWo for additional raters' Evaluation of Potential 
and to 24% for reviewers' Evaluation of Potential. 
No single Performance Factor makes an appreci- 

^-able independent contribution to -these levels of 
predictive efficiency. The statistical analysis of the 
data indicate^*''tfiat one or more of the Perform- 
ance Factors could be deleted from the Form 707 
without affecting the manner in which the rating 
official evaluates the ratee's potential. Com- 
parisons involving the independent contribution of 



each of the Performance Factors indicate that it 
would make very little difference which Perform- 
ance Factor or subset of Performance- Factors are. . 
removed • frorh consideration. Within the minor 
differences that do appear, the Written Com- 
munication and Job Knowledge factors make less 
independent contribution than do die other 
Performance Factors. 

While raters' Performance Factors do account 
in some degree for reviewers' Evalution of ^ 
Potential ratings, the best single predictor of 
reviewers' Evaluation of Potential is the additional 
raters' Evaluation of Potential. Perfoqjiance 
Factor ratings add essentially, nothiag to the 
predictive efficiency provided by the additional 
ratecs' Evaluation oCPotential. 

The above discussion pertains^o lieutenant 
colonel reports. The use of Performance Factors 
and the relationship of Performance Factors for 
rating^of Evaluation of Potential may vary con- 
siderably as a function of the ratee's grade. 
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